


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations l. Thesis and Dissertation Collection, all items 


1972-09 


The use of known classical system reliability 
estimation methods to approximate the final 
solution in Bayesian methodology. 


Mattis, David William 


Monterey, California. Naval Postgraduate School 
http://hdl.handle.net/10945/16423 


This publication is a work of the U.S. Government as defined in Title 17, United 
States Code, Section 101. Copyright protection is not available for this work in the 
United States. 


Downloaded from NPS Archive: Calhoun 


Calhoun is the Naval Postgraduate School's public access digital repository for 
г DUDLEY research materials and institutional publications created by the NPS community. 
FW чу. Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS's first 


ІШ КМОХ appointed — and published — scholarly author. 

ы. LIBRARY Dudley Knox Library / Naval Postgraduate School 

411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 





http://www.nps.edu/library 





THE USE OF KNOWN CLASSICAL SYSTEM 
RELIABILITY ESTIMATION METHODS TO 
APPROXIMATE THE FINAL SOLUTION 

IN BAYESIAN METHODOLOGY 


David William Mattis 





NAVAL POSTGRADUATE SCHOOL 


Monterey, Galifornia 





ЖЕЕ ОФ 


TPHEUSE OP KNOWN CCASSICALCS ISTEM 
RELIABILITY ESTIMATION MEI HOODS TO 
APPROXIMATE THE FINAL SOLUTION 
IN BAYESIAN METHODOLOGY 


by 


David William Mattis 





Thesis Advisor: W. M. Woods 


7 September 1972 


Approved for public release; distribution unlimited. 





The Use of Known Classical System 
Reliability Estimation Methods to 
Approximate the Final Solution 


in Bayesian Methodology 


оу 


David William Mattis 
Lieutenant, United States Navy 
B.S., United States Naval Academy, 1966 


Submitted in partial fulfillment of the 
reguirements for the degree of 


MASTER OF SCIENCE IN OPERATIONS RESEARCH 


from the 


NAVAL POSTGRADUATE SCHOOL 
september 1972 


— 
= 

Zu 

val 





ABSTRACT 


This thesis examines Taree methods for calculate 
100(1-&%)% lower confidence limits for the reliability of 
a K-sized series system. Assuming that each component 
перо Оу has а веба disteloution, identical posue 
Mrameters A and B are assigned for each componenti A 
ею sinulation model is then developed to determine 


A 
values of R Ме опао и 


s,L@)° 


A 
Милета to attributes Gata, and E 5 сошршнеш 


з „1, (е<) 
using classical CHI-SQUARE methods, and the WOODS-BORSTING 


о as спгсе values tare then Compared. Ол еен 
Ше alternative approximations are examined, the results 


indicate that a high degree of accuracy in computing 


А 
8 L (e) is possible with the classical or WOODS-BORSTING 
2 


Mebnodas, and that іс may not be necessary to resort to 


i л 
costly simulation techniques to obtain values of R " 
S „E 
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т. INTRODUCTION 


The problem of determining lower confidence limits on 
the reliability of a K-sized series system using component 
attributes data only has been studied from the standpoint 
of both classical methods and Bayesian methods. One classical 
method, the WOODS-BORSTING Method“ 15 used in cases where 
unequal sample sizes of each component in the series system 
Шы с ресе, 

The classical CHI-SQUARE method treats system reliability 


ЕШ сопзвате ама сотрисез спе Тошев ост е е ит B 


solving the equation 


A AZ, 2F+2 
L Aa 
where R is the 100(1-e6)2 lower confidence limit, F 


5,1 (26) 
is the total number of failures, and N is the common sample 


„size, with each component having an egual sample size for 
mesting. Attributes data, obtained by mission testing, as 
Иса со calculate F. | 

The classical WOODS-BORSTING (W-B) Method computes the 
Mayer confidence limit for system reliability from the 


formula 
A 


A neg t ee bd in, p 


lNaval Posteraduate Schoot Report Аја ен ее 
No. SP-114, A Method for Computing Lower Reliability Limits 
Using Component Failure Data with Unequal Sample Sizes, by 
J. R. Borsting and W. M. Woods, pp. 210 опен о 
Hereafter cited as WOODS-BORSTING. 








where Ry is the reliability of component) ло лосион 
and 4 is a logarithmic func -ron ог Ту. The term fT is 
a function of f. (the number of ee of component i), 
and n4 (the sample size of component i). 

In the Bayesian methodology, the reliability of each of 
the K system components is considered to ре a random variable. 
ANsisumine that component reliability is Beta distribuce ma 
Шы тог Set ol parameters, А, апа Bi 2s assumed. ТІ е КЕ 
each component are mission tested (ie., tested for a length 
of time equal to the required mission length), and successes 
(54) and failures CP.) ape obtained for each component 
ШО 12. Ко Application of these асовзороеев кее сее 
wre prior distribution results in the reliability of each 
component being Beta distributed, with posterior parameters 


А. + 5 


i 33 and B. t f.. Assuming 1паерепаепсе ашопе сеощрошеша- и 
al 1 


the theoretical system reliability 15 


k 
E => E 


S As! ae 
ВЕ distribution of Re 15 then determined ана Lack alimen а 
A 
R Р 
s ,L(e) 


Wich systems Decoming more Costly. che Bayesian apr ваја и 


Percentile of Chis роет о A 


with its desirable feature of a smaller required sample size; 
is becoming more popular. Past mission test data of tech- 
nically similar systems can be utilized by engineers and 
scientists to arrive at a prior distribur lonwer ые E 
lying component reliability. The posterior ан = Стопа и 
however, difficult to determine. те ргоа иссо nn 


reliabilities, each Beta distributed, presents formidable 





problems to the statistician, With regard cuo Е 
tribution, and mathematical vrecta sa 

A computer simulation technique, using randomly 
generated Beta variables with the desired posterior parameter 
values can be used to determine the 100(1-e&)% lower confidence 
mit Гог system reliability. Alternatively one migni 
approximate this value by converting the posterior parameters 
into "equivalent" attributes data, and using the 100(1-e )% 
classical lower confidence limit calculated directly from 
the formulas given above as the Bayesian lower confidence 
Шитье. That is, use known classical system reliability 
estimation methods to approximate the final solution іп 
Bayesian methodology. The accuracy of this approximation 


is the basis for the research detailed in this thesis. 





ТТ. EXPERIMENT AD SE ROCIO is 


In order to develop a source of data with which 
meaningful comparisons could be made, it was necessary to 
make some basic simplifying assumptions. It was decided 
that an assumed posterior distribution for each component 
ШӘЛІСІ De utilized. Further, it was decided that each 
component in the K-sized series system would have identical 
posterior parameters. As a result, the parameters А, апа 
5. become simply A and B. 

The next step was to develop a computer simulation which 
could be used to generate the distribution of system relia- 
iy, utilizing the given BetaMparameters A and В. син 
Pes distribution. the value of — Conta ape 
determined. 

Ке gc GC cM GI parameters would be converted into 
attributes data. The classical formula and the WOODS- 
BORSTING formula could then be applied and corresponding 
alles of system reliability lower confidence limits 
gevermined. 

After tabulating these values for AOT obtained by 
Means Of the three methods. according ito А тапа пан гид 
as well as by K, the system size, an attempt would be made 


to identify which tended to give "more accurate" results. 


‘in order to assist іп this identification kare“ el 





A A 
values would be calculated. These were M l-(1-R)K, 
^ 
and F (total failures), where R is the estimated mean of 


^ 
the posterior distribution, defined by R = Ą 


А+В 
A. COMPUTER SIMULATION 


Let X be a random variable with an exponential distribution. 


Let 


B 
-InR =) Xx, 
421 
where 
X4 is exp(A) 
X, 15 ехр (А+1) 


Ха 15 ехр(А+В-1) 


Then R has a Beta distribution, and” 


в 
R = exp(- > X.) 
Жа 


A computer program was developed to generate a series of 
B random exponential ООО. Using the above theorem these 
numbers were then summed and converted to a single random 


variable, with a Beta distribution, and parameters A and B. 


| “Operations Evaluation Group, Center or Nave line cos 
ee the University of Rochester. TBeseazehrtongribupleone ae Zr 
Confidence Limits for System Reliability, by J. Bran, 
Appendix A, 15 March 1968. 


?Emshoff, James R. and Sisson, Roger L., Design and Use 
oí Computer simulation моде, рели ке а ја ин cer 





This procedure was then repeated K times, stotims the 2 
and multiplying the numbers together as they were developed. 
The result was a single number for system reliability. The 
complete procedure was them repeaceds 1000 Grimcsen or oma 

each value of system reliability. The 1000 values were 

paren placed in order from Low со ара про и сесии NE 
AM SLTIDULIORN Of system reliability, based Upon the wary ou 


A 
values Гог A and B. R was then the a th 


s,L(e) 
of this distribution (ie.,e€ =.10, then R(100) is the desired 


percentile 


estimate). This program was used to generate values of 


A 
Rs L(et) over a range of values for A, B, and K. 


B.  WOODS-BORSTING FORMULA 


This formula provides a method for computing lower 
Eu uPdenece limits on the reliability of a series system. 


The formula is repeated И 


Es Lío) = exp ша Ва ра) 





where 
K AD 
A A NET Ab ist 
ae DER e aT 
ле! 
апа 
K a 4 К A 
п.-3 А AD 22 
“= i + AAN 
NE De n,-1 2 2 (n4 -1) п. п, -1 
Аз) E АЕ 
Ц 


WOODS-BORSTING, pp. 2-8. 





with a continuity correction to improve асот 


The accuracy of the above formula is a function of the 


5 


amount of testing, relative со component UNE CL а 


A value of F in excess of 5 is considered to be sufficient 


^ 


for reasonable accuracy of Re L(t): 


С. CHI-SQUARE FORMULA 


For a series system with independent components, the 
oem reliability is the producit опе component ie 


Шар ја је5. 


А 
To find the 100(1 6)7 wenecconistcie e по г Гог 


s,L(&) 


be, One proceeds as follows: 
5 


Using mission test data Only on compomeny рали ин 
equal sample sizes, the values of n, (sample size), f. 
(number of failures), and 5. (number of successes) for 


 шролпело 1, 1-1 2 ,..„Кк are obtained. 


Then 
Da Sa 
m LS 
ni 

and 
A К Ал 
E R = TTR. 
M 


> WOODS-BORSTING p. 9. 


10 





Rewriting gives 
K A A 
=“ as 


A 
If 9; is small this can be written as 


A © 
& -Tra-4) 1-20, 
aži 


As! 
The term n,Q, is distributed EE Poisson(n,Q, ) 
Kor Q.<.1, and n, 19.>2. e 


51,0, = Y rer, menda, ) 


де! A? дай 
for equal sample sizes n47n5-...-ny7n. 
if X is distributed Poisson (A) and there is one observation 
eu A, then! 


A > Хе 2X+2 


K 
and since DEC. is approximately Poisson (n 2.01), then 


А 21 з £21 





к 2 к 
Де = Va 2F+2 F=f 
sei I] U(e) 2 и ^ 
апа N 
к AŠ 
© = “ш 2Е+2 = 1-Е 
= Пе) A s, Le) 
Therefore 
A x 2 
R + 1 - OF+2 
5,6) "ERST 


6 
Parzen Е, Modern = гора ту Theory and Its Applications: 
p.e 245, 401, Wiley, 1960. 


Uso n D. K. and Lipow, M., Reliability: Management 


3 
Methods, and Mathematics, p. 218, Prentice-Hall, 1962. 





This formula is accurate if the underlying assumptions 
used in its derivation are мао тисе 9; и 
апа n,Q; greater than 5. теза жп 9; being sna елси ch 
can be developed from the maximum likelihood estimators 


ӘН and Hos 
i S 


Recall 
K 
E - TTR, 
А21 
then 
A Ka K A 
В. za = 1 - 2 (1-R;) for small 6, 
А 2 А 
апа 
А.К л 
(R) = 1 - K(1-R) for idonei cal 


attributes data 
If these two values are in close agreement with each other, then 
one may assume that Bom calculated from the classical 
CHI-SQUARE formula, is an accurate estimate. [n a point 
estimate for R, is the mean of the Beta distribution; that 
15 


A 
t ДУ. 


А 
А+В 
D. OBTAINING ATTRIBUTES DATA 


in the application of Bayesian statistics with a given 
prior Beta distribution of R, parameters A' and B' are 
assumed, based on some measure of how reliable a component 
is. For example, if no knowledge of the component reliability 
is available, a uniform prior (A'-B'-1) is assigned. This tends 
to be the exception rather than the rule тис ева вены 
alent in the classical sense of allowing only one success- 


ful test before actual mission testing takes place. 


2 





In essence, the assignment of prior probabilities А" апа 
В! is equivalent in the classical sense of allowing A'+B!-1 
tests, with A' successes, prior to Gečiai Еа еее вв 


си percentile point of the Beta 


ШБ tree Saus ныне 
distribution is the lower 100(1-* )% confidence limit for 
Је оне Е а јеси аре иа ето Ва Zeh 
probability of suecess R, and A' of these trials are 


8 


puecessiul., After mission testing N items, with S successes 
Emus" falillures, the posterior distribution of comp onent 
ability is Beta distributed. with parameters AA Se 


and B=B'+F. This in turn is equivalent to having had 


(A'+S)+(B'+F)-1 


= А+В-1 west cr, 
with 
ATS 
=A SUCCESSES 
and 
(Bt+S)-1 
-B-1 failures 


Thus, given posterior parameters A and B, the conversion 
to attributes data is 
Number of tests A+B-1 
Successes A 


Failures B-1 


DeGroot, Morris H., Optimal Statistical Decisions, p. 160 
MeGraw-Hill, 1970. 


2 


13 





III. PRESENTATION OF DATA 


A 
Values of R obtained by means of the simulation 
s,L(e) 
(SIM) model, the WOODS-BORSTING (W-B) Method, and the 
CHI-SQUARE or classical (CL) method are presented on the 
following pages. The values of A, B, and K used were: 
A: 50, 100, U0 
E 3, Ц 
Moms. О eho ко, 20. 110 
In addition, © values of „05, „10 and „20 were used. 
To use the tables, first find the page with the desired 
values of A and В. Read down the left column until the 
A 
desired value of K is located. The values of R are 
S ,L(et) 
a ranged to the right, under the indicated A value. 
A 
The point estimate, R, for each component are given 
пе Бор Of each table. Іп addition, the right sid <an 
each table lists values of F (total failures), as well as 
^ ^ 
E“ and 1-(1-R)K, 
As an example of how to use the tables, suppose one 
A 
wishes to compare values of R { , for A=100, B=3, 
е Le) 2 
апа К-Т. Turning to the correct table and reading down 
mie Vell and across, OMe finds 
A 
A=100 B=3 R=.971 


ob =.10- 
К. с. Ие МИ Е 


7... .16 „80 .81 


14 
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IV. CONCLUSIONS 


A 
In order to present the tabular values of R їп а 


Ss, List) 
more meaningful manner, they were plotted as a dependent 
moriable, using K as the independent parameter, for a fixed 


Mete on A Be and et . Three curves were plotted TOne T LoL 


each method. In addition a new variable A was defined as 


p [о-в] „ Ве А 


A A 
A+B 


ІҢ 


and was plotted on the same graph, depending on the values 
ОГ А and В. This was done to show the increase in the error 


A 
ОГ К with K due to the simplifying assumptions made 


5,1. (66) 
in developing the CHI-SQUARE formula. These curves are 
shown in APPENDIX A, 

For the case A=50, B=2, plots were made for all three 
& values. There was no major difference observed in the 
сигуез аз < was varied. As expected, the curves were higher 
mot a given value of K asoc was increased. The plots were 


A 
Hooked at from the point of view of ranges of R, as defined 


A 
by A/AtB. Two cases were examined, R 2 .98 and R = .98. 


л 
ЦК CASE 1; R = „96 
A 
Por values of Rz 958 the уа of АЕО о 
increased gradually. Both the W-B and CL curves provided 


A^ 
SDC ims Lac values OI using the Бш а стоп ее 


mE E 
(SIM) as a basis for comparison. The classical curve gave 


a smaller relative error except for values of K less than 
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about 10, where the W-B curve наз с обет eN 
All three curves showed the Same Co саса 
increased, and all three curves werpredpeasomemi dc 


each other. 


^ 
БЕН CASE Ir; R «7.99 
^ 
For values of R <.98 the curve of R for the 
S ,L (et) | 
classical method crossed the SIM curve, providing an op- 
A 


та Бле prediction for R at lower values of K and 
S ,L(e) 
a pessimistic value for higher K values. This changeover 
occured for values of K as low as 9 and a high as 35, 
A 
increasing as R increased. The W-B curve was once again 


consistently optimistic compared with the simulation curve. 


The А curve increased rapidly for Е < .98. 


С. GENERAL CONCLUSIONS 

Since the system reliabilities which would logically 
Bec ssumed to be of importance to scientists and engineers 
are those in excess of озера те с ла a en Of Hisn 
EuStem eost considerations, it is concluded from the plots 
peat for a value of Rs (er) san obtained by the simulation, 
ШІ ехсезв Of ./5, both t'.e classical and the WOODS=BORSTENG 
Methods give guite good approximations to the final solution 
obtained in Bayesian methodology. Even though both the 
WOODS-BORSTING and the classical formulas yield optimistie 
values, the maximum error in the range of (SIM) Es La) E „75 


is .10, for the parameters used. 
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D. AREAS OF FUTURE диша 

The parameters used were chosen such that each component, 
when converted to attributes data, had the same sample size 
as all of the remaining K-1 components. This was done to 
ascertain whether or not the classical formula, valid only 
for equal sample sizes among components, could be used as 
an approximation to the final solution. For unequal sample 
sizes, the WOODS-BORSTING formula must be used -- the 
classical formula does not apply. it remains to be seen 
whether or not the estimates obtained by means of the 
Simulation model can be accurately approximated by the 
W-B formula, with unequal sample sizes, and varying numbers 
Of failures, for each component. The K value was not 
examined beyond 40. A trend is evident on the curves, 
but research should be done for K>40, rather than a mere 
extrapolation of the data. 

Parameter values studied for A and B were limited to 
EBS presented. A posterior — for À in excess of 
ША 15 necessary to yield high system reliability confidence 
mmits for values of K in excess of 15. This area was 


not examined, 
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DEFINITION OF VARIABLES IN COMPUTER PROGRAM 


VARIABLE 

AA | Roster torpe ome ои 

BB POsWec Gilera paramere te. 

DATA (Jd) Reliability of component (J) 

DEV Standard deviation of system reliability 
IX Каса тост асе 

К Number of components in series 

ENSREL(CI) System reliability for replication (I) 
XBAR Mean у те Ot Sysuem вел ара тик у 
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SIMULATION CF SERIAL SYSTEM RELIABILIT TIS TIC 


BETA DISTRIBUTED COMPONENT RELCTABILTTTES 
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GENERATE BETA DISTRIBUTED RANDOM VARIABLES 
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STORE VALUES OF RANDOM VARIABLES 
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